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Abstract 



r^ • Spatial evolutionary games model individuals who are distributed in a spa- 

d , tial domain and update their strategies upon playing a normal form game with 

their neighbors. We derive integro-differential equations as deterministic ap- 
proximations of the microscopic updating stochastic processes. This generalizes 
the known mean-field ordinary differential equations and provide a powerful 
^ I tool to investigate the spatial effects in populations evolution. The determin- 

istic equations allow to identify many interesting features of the evolution of 
1^ . strategy profiles in a population, such as standing and traveling waves, and 

^^ I pattern formation, especially in replicator- type evolutions. 

I> 

^ ■ Keywords: Evolutionary games, mean-field interactions, deterministic approxima- 

tion, Kac potentials, pattern formation, traveling wave solutions. 

>'■ 

X 



^We thank William Sandholm for his useful suggestions and comments. The research of the S.-H. 
H. was supported under grants NSF-DMS-0715125. The research of M.A.K. was supported by the 
National Science Foundation through the grant NSF-DMS-0715125, and the European Commission 
Marie-Curie grant FP6-517911. The research of L. R.-B. was partially supported by the NSF under 
grants NSF-DMS-06058. 

^corresponding author, email: hwang@math.umass.edu 

•^email: markos@math.umass.edu 

'^email: luc@math.umass.edu 



1 Introduction 



Many macroeconomic phenomena occur as the aggregate results of the actions and 
interactions of many and unrelated agents. Interactions among agents are inherently 
local because they are separated by spatial location, language, culture, and etc. As an 
example the occurrence of depression or inflation might depend on the decentralized 
decisions of many agents to save or consume based on the local economic conditions. 
Another example of a social phenomenon where spatial considerations matter is the 
decision on where to live, which frequently depends on the neighbors living there 
and this, i n turn , can induce the spatial patterns of segregation in residential areas 
( jSchellingl . Il97ll ). Our main goal in this paper is to develop tools to understand the 
implications of spatial interactions in evolutionary games. 

We consider a class of spatial stochastic processes in which agents are located on 
vertices of a graph and update their strategy after observing the strategy of a dis- 
tinguished set of their neighbors. Such s tochastic models have been s tudie d in evo 
l ution a ry gam e theo r y by, among o t hers, 



fll993h ■ iBlumel fll993[ ) . Blumel f llQQSh 



Kandori. Mailath. and Rob 



(119931) 



Ellison 



Youngl (|1998|). In mean-field models without an y 



consideration of geometrical proximity (e.g., see iKandori. Mailath. and RobI ( 19931 )). 
every player is considered a neighbor and is given the same weight in evaluating pay- 
offs and the model can be described using only the aggregate quantities such as the 
proportion of players with a given strategy. 

The popular use of mean-field stochastic models in evolutionary game theory is 
mainly due to the simple structure of the stochastic processes. While these models 
demonstrate effectively how the combination of the myopic strategy revision and the 
random experiments (noise or mutation) of individuals can lead to a selection of an 
equilibrium from among multiple Nash equilibria, they assume that everyone in a 
population interacts uniformly with the entire population of players, neglecting the 
local structure of interaction. Because of this, these models fail to address the im- 
portance of the locality of interactions in forming the globally observed phenomenon. 
The range of interaction itself is a critical factor in determining the speed of conver- 
gence to equilibrium and the time th at the society locked in a "bad" state such as 
Pareto-inefficient state. For instance, lEllisonI (119931 ) shows that the speed of conver- 
gence in the system with the uniform interaction in a large population is very slow 
and so the question of equilibrium selection in the mean field models may not yield 



a useful insight. 

By contrast, in model s with l ocal i n teractions pla y ers inte r act w ith a fixed finite 
set of neighbors (e.g . , see Blumd (1l993h . lBlumel ( 1l995l ). lYoungl (1l998l Chapter 5) and 



see 



Szabo and FathI (120071 ) for a comprehensive survey of spatial evolutionary games) . 



Some important questions about equilibrium selection and speed of convergence to 



equilibrium have been addr essed for special mode 



993hJEllisonl f ll993h 



s using tools such as stochastic sta- 



Blumel fll993[ ). lYouneJ f ll998h 



bility a nd Gibbs measures (lYoung ( 

See also iFreidlin and Wentzelll ( 1l984j )). These results are however limited to either po- 
tential games and logit dynamics or coordinations games and perturbed best response 
dynamics; many other important games addressing economic problems — such as the 
Rock-paper-scissors games — are neither potential games nor coordination games. 
Also another important behavioral rule like imitative updating, which may arise from 
the limited information or poor computational ability of agents, might exhibit very 
diffe rent phenomena and should b e compared to the (perturbed) best response rule 
(See lLevine and Pesendorferl ( 20071 ) : lBergin and Bernhardtl ( 20091 ) for the importance 
of imitative behaviors). However, these questio ns using s tocha stic and probabilistic 



Durrett 



(119991)). 



methods lead to very difficult problems (e.g. see 

We concentrate here on an intermediate case, local mean-field models where a 
given player interacts with a substantial proportion of the population, but where 
spatial variations in the strength of interactions are nonetheless allowed. By consid- 
ering the intermediate model, we are able to rigorously derive deterministic equations 
which approximate the original stochastic processes. The distinctive advantages of 
our approaches lie in that under our assumptions, the questions of pattern formations, 
equilibrium selection, and the speed of convergence at the level of complex stochastic 
processes can be directly translated into those at the level of the differential equations 
- a level which is more tractable and also incorporates some underlying stochastic de- 
tails. An attractive feature of the derived differential equations is that it can provide 
tractable and systematic tools which can examine the relationship between the lo- 
cal heterogeneity and the globally observed phenomena; for example, one can easily 
study how a given set of preferences of individuals at a certain neighborhood can lead 
to segregation patterns in the residential areas. 



In t he curren t litera t ure of evolu t ionary game theory, (e.g. iHofbauer and Sigmund 



(120031 ): IWeibullI ( 1l995l ): ISandholml ( l2010l )). the time evolution of the proportion of 
agents with strategy i at time t, /i(i), is specified by an ordinary differential equation 



of the type 
d 



keS keS 



Q^m) = E c^^(A;,2,/,)/*W - W) E c^^(^,^,/t) for I G S. 



Examples of such equations include the well-known replicator dynamics, the von- 
Neumann Nash dynamics, and the logit dynamics. The first term in equation ([T]) 
describes the rate at which agents switch to strategy i from some strategy other than 
i, while the second term describes the rate at which agents switch to some other 
strategy from strategy i. For this reason equation ([T]) is also called an input-output 
equation. 



It is well-known (JKurta . Il97d : iBenaim and Weibulll . l2003l : iDarling and Norris 



20081 ) that the solution of equation ([T]) ft{i) approximates, on finite time intervals, a 



suitable mean- field stochastic process, in the limit of infinite population, and ft{i) is 
the average, over the entire spatial domain, of the proportion of player with strategy 
i. In our local mean-field model where spatial structures survive, we will describe 
instead the state of the system by a local density function ft{u,i). Here u belongs 
to the spatial domain A C M" where agents are continuously distributed and ft{u,i) 
represents the proportion of agents with strategy i at the spatial location u. Our 
main result is that local mean-field stochastic processes are approximated, on finite 
time intervals and in the limit of infinite population, by equations of the type 

d 

^ft{u,i)=Y.ciu,k,i,ft)ft{u,k)-ft{u,i)Y,c{u,i,k,ft) ioi i e S , (2) 

(^ keS k£S 

which provides a natural generalization of equation ([1]). For example, the term 
c{u, k, i, f) describes the rate at which agents at spatial location u switch from strat- 
egy k to i. This rate depends on the strategies of agents at other spatial locations 
and typically, c{u, k, i, f) will have the functional form 

c(u, k, i, f) = G{k, i,J'* f{u, i)), where JT" * f{u, i) := / J'{u — v)f{v, i)dv . 

Here J7 * / is the convolution product of J' with / and J^{u) is a non-negative 
probability kernel which describes the interaction strength between players whose 
relative distance is u. When J' is constant equation ([2]) reduces to equation ([T]). Note 
that the rate of increases in ft at u depends on ft{v, i) for all v in the spatial domain 
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(a) Traveling front 
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(b) Imitative update vs 
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perturbed best response 



Figure 1: Traveling front and strategy choices Panel (a) illustrates how a traveling 
front solution can describe the propagation of a strategy to the whole spatial domain for a two 
strategy game. Panel (b) shows the configurations of strategy choices of individuals at each site 
(white circle: strategy 1, black circle: strategy 2) In the replicator dynamics (the left: an example 
of imitative updating rules) the interface between the choices of strategies is sharp; in the logit 
dynamics (the right: an example of perturbed best response rules) the interface is not sharp 



A and that equation ([2]) is non-local; so, the equation is called an integro- differential 
equation (IDE). 

We will obtain this equation in a suitable spatial scaling where agents are con- 
tinuously distributed in a spatial domain A and is often called a mesoscopic scaling 
in the physics literature. For this reason equations of the form ([2]) are often called 
mesoscopic equations but are sometimes also referred to as local mean-field equa- 
tions. Mesoscopic lim its simil a r to o u rs have been derived in several models in sta - 
tistical mechanics bv ICometd (1987). iDeMasi. Orlandi. Presutti. and Triolol (Il994j ). 



Katsoulakis. Plechac. and Tsagkarogiannid (l2005l ). and others. We generalize these 
results to the spatial stochastic processes arising in evolutionary game theory. Other 
scaling limits, such as hydrodynamic limits, where space and time are scaled simulta- 
neous ly, giving rise to evolving fronts and interfaces, e.g. iKatsoulakis and Souganidis 
(119971 ). are also potentially relevant to game theory but will not be discussed here. 

Specifically, using this approximated equation we study the effect of a given initial 
condition and behavioral update rule on pattern formations and observe that when 
individuals behave by imitation of their close neighbors, the segregation of choices of 
strategy may develop and persist (see Figure [2]). But in a society where (perturbed) 
best response rule is the dominating behavior, we observe that the system, instead, 
converges everywhere to a "rational" equilibrium exponentially fast (see Figure [11(b) 
for comparison of interfaces). The traveling front solutions shows a propagation of a 
local strategy profile into a global domain of the space and plays an important role in 
examining the selection of equilibrium from among multiple Nash equilibria and the 




Figure 2: Pattern Formation in the replicator dynamics We use two-player coordi- 
nation game witli an = 2/3, 022 — 1/3, 012 = a2i = 0. The left and middle panels show the time evo- 
lutions of population densities of strategy 1 in the spatial domain T^ — [— tt, tt]^. The number of nodes 
is 64 and the time step is 0.0175. The initial conditions are 1/3 + randcos(a:) cos(y) (upper panel) 
and 1/3-1- rand cos(2x) cos(2y) (lower panel), where rand denotes a realization of the uniform random 
variable [0, 1] at each node. For the interaction kernel, J7(r) = exp (— 6a;^) / / exp(— 6a;^)da;, h = 15. 
The right panels show the contours of the densities at < = 22. 



speed of convergence to equilibrium (see Figure [T] (a). iHofbauer. Hutson. and Vickers 
(jl997l )). In our models, in imitative dynamics, we observe an extremely slow transition 
to the better equilibrium in contrast to standard beliefs on equilibrium selection. 

Current approaches to address the pattern formation and the existence of traveling 
front solutions in evolutionary games have traditionally employed reaction-diffusion 
partial differential equations; such models are typically obtained by adding a constant 
coefficient diffusion term to the mean-f ield equations, which in turn models fast but 
homogeneous spatial diffusion of agent s 
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Mu,z)=Zc''{k,t,f)ft{u,k)-Mu,z)Zc''{t,kJ) + eAf 



(3) 



fees 



kes 



In contrast, in our scaling- limit approach, the spatial effects are introduced at the 
microscopic level and lead to diffusive effects which differ markedly from equation to 
equation and are, in general, density dependent. This introduces a number of new 
interesting spatial structures which are absent in reaction-diffusion equations. 
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The paper is organized as follows. In Section 2 we introduce the stochastic process 
and the scaling limits, and present our main results (Section 2.3). A heuristic deriva- 
tion of the equation is given in Section 2.4 and the relation with ODE such as ([I]) is 
elucidated in Section 2.5. In Section 3 we analyze equilibrium selection and pattern 
formation in two player coordination games using a combination of linear analysis 
and numerical simulations. In the appendix we prove our main results. 

2 Spatial Evolutionary Gaines 

2.1 Strategy Revision Processes 

In models of spatial evolutionary games, agents are located at the sites of a graph 
and play a normal form game with their neighbors. The graph A is assumed here to 
be a subset of the integer lattice U^ . We consider a single population playing a normal 
form game, but the generalization to multiple population games is straightforward. 
A normal form game is specified by a finite set of strategies S and a payoff function 
a{i,j) which gives the payoff for a player using strategy i E S against strategy j G S. 
Here we view a strategy as a type of behayior and so terms, "strategy" and "t ype" , 



are used interchangeably (JMaynard Smithl . Il982l : iHofbauer and Sigmundl . Il998l ) 



The strategy of the agent at site x G A is ua (x) G S, and we denote by a a = 
{o"a(x) : a; G A} the configuration of strategies for every agent in the population. With 
these notations, the state space, i.e., the set of all possible configurations, is .S* ^. The 



subscript of cr = cta will be suppressed, whenever no confusion arises. As in [Young 



(1l998l . chapter 6), we assign positive weights >V(x — y) to any two sites x and y to 
capture the importance or intensity of the interaction among neighbors. Note that 
we assume that these weights depend only on the relative location x — y between the 
players (i.e., we assume translation invariance). It is convenient to assume that total 
weight that site x attaches to all its neighbors is normalized to 1, i.e., 

5^W(x-y)^l. (4) 

j/eA 

We say y is a neighbor of x whenever yV{x — y) > 0. An individual agent, at site x 



with strategy i given a configuration a, receives an average payoff 



u[x, a, I 



^W{x-y)a{i,<j{y)). 

i/gA 



(5) 



If we think of W as the probabihty with which an agent samples his neighbors, then 
u{x,a,i) is the expected payoff for an agent at x choosing strategy i if the popula- 
tion strategy profile is a. Or we can think that an agei it recei v es an instant a neous 
payoff flow from his int eractions with other neighbors (JBlume 
Young and Burkd . l200ll ). 
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1998 



In the special case where W(x — y) is constant, the interaction is uniform and 
there is no spatial structure and if there are a total of n'^ agents in the population. 



then >V(x — y) ~ ^ because of (jlj). On the other hand, when VV(x — y) 

\\x — y\\ = 1 and otherwis e, interactions only arise between nearest sites (iBluni' 



-3* 



if 



1995 



Szabo and Fath 



20071). 



In this paper we concentrate on long range interactions where each agent interacts 
with as many other agents as in the mean-field case , but the intera ction is not uniform. 



his limit is known as "local mean field model" ( 



(Lebowitz and Penrose 



196 



a 



Comets 



lllMzl) 



or "Kac potential" 



DeMasi. Orlandi. Presutti. and Triolol . Il994 : 



Presutti 



20091 ). More specifically, let J{x) be a non- negative, compactly supported, and inte- 
grable function such that j J{x)dx = 1. We assume that W has the form: 



>V^(a; -y) = YJ{i{x - y)) 



(6) 



and we will take the limit K /^ TL^ and 7 — )■ in such a way that 7^^^ ~ |A| ?^ n'^. 
Here n'^ is the size of the population and | | denotes the cardinality. Hence the factor 
7*^ is chosen in such a way that ^ VV'^(a; — y) ~ / J{x)dx = 1, so W'^(x — y) indeed 
represents the intensity of interactions. Note that in ([6]) the interaction vanishes when 
\\x — y\\ > -R7~^ if JT" is supported on the ball of radius R. So as 7 — )■ 0, an agent 
interacts very weakly but with a growing number of neighbors in the population. 
Frequently, in examples and simulations, we consider localized Gaussian-like kernels 
J^{x) oc exp(— 6 ||x|| ) for some 6 > 0. 

The time evolution of the system is given by a continuous time Markov process 
{at} with state space S^, in which each agent receives, independently of all the other 
agents, a strategy revision opportunity in response to his own exponential "alarm 



clock" with rate 1, and then updates his strategy according to a rate c(x, a, k) — the 
rate with which agent x switches to strategy k when the configuration is a. This 
process is then characterized by a generator 



where 5^ is a bounded function on S^ and 



xeA kes 



/c if y = X 

represents a configuration where the agent at site x switches from his current strategy 
a{x) to a new strategy k. 

If c (x, 0", /c) > for all x, a and fc, the stochastic process can introduce any new 
strategy, even if it is not currentl y used in the population. We call this case innovative 
following ISzabo and Fathl ( 120071 ) . If c{x, a,k) = for some x, a, and k and hence a 
strategy which is not present in the population does not appear under the dynamics, 
we call the dynamics non-innovative. Furthermore if, upon switching, agents only 
consider the payoff of the new strategy we call the dynamics targeting. In contrast, 
when agents' decision depends on the payoff difference between the current strategy 
and the new strategy we call the dynamics comparing. 

Precise technical assumptions for the strategy revision rates will be discussed 
later (Conditions CI— C3 in Section [2^3]) : here, we give only a number of concrete 
examples commonly used in applications, and to which our results will apply. Several 
more examples of rates are discussed in the Appendix and the assumptions on our 
rates are s atisfied by virtually all dynamics commonly used in evolutionary game 



theory (see ISandholnj . I2OIOI for a more comprehensive discussion of rates and more 



examples). To define the rate we introduce 

w{x, cr, k) := E ^(^ - y)^i(^iy),k) 

yeA 

where S{i,j) = 1 ii i = j and otherwise; w{x, a, k) can be interpreted as the proba- 
bility for an agent at site x to find a neighbor with strategy fc, provided the neighbors 
are sampled with the probability distribution W(x — y). Let also F denote a non- 



negative function. 



Examples of Rates 

• Comparing and Innovative: The rate is c(x, a, k) = F{u{x, a, k) —u{x, a, cr{x))) 
and is comparing and innovative provided F > 0. When 

c(x, a, k) = niin {1, exp {u{x, a, k) — u{x, a, cr(x)))} , 

the rate corresponds to a generahzation of the well-known Metropolis algorithm. 
In particular, when the normal form game is a potential game, the corresponding 
Markov chain satisfies detailed bal ance and its invariant d istribution can be explicitly 
expressed as a Gibbs distribution (jSzabo and Fathl . 120071 ) . 

• Targeting and Innovative: This case arises if c{x,a,k) = F[u{x,a,k)) and 
F > 0. If 



c{x, a, k) 



exp(M(a;, cr, k)) 



^iexp{u{x,a,l)) 

the rate is called "logit choice rule" in the game theory literature, and it is a general- 
ization of the "Gibbs sampler" in statistics and of the "Glauber dynamics "of physics. 
The Markov process, in this case too, satisfies the detailed balance for potential games 
and has the same Gibbs invariant distribution as Metropolis dynamics. 

• Comparing and Non-innovative: The rate has the form 



c(x, a, k) = w{x, a, k) [F(m(x, a, k) — u{x, a, cr{x))] . 



(9) 



This specifies an imitation process: the first factor w{x, a, k) is the probability for an 
agent at x to choose an agent with strategy k and the second ia.ctoT F(u(x,a,k) — 



u(x,a,a(x))) gives the rate at which the new strategy k is adopted (jWeibuU 



Benaim and Weibull 



1 



1995 



2003t iHofbauer and Sigmundl . 120031 ). The standard example is 



c{x, a, k) = w{x, a, k) [m(x, a, k) — u{x, a, a{x))] 



(10) 



where [s]_,_ = max{s,0}. The rate ( TTOl) . in the mean-field case, gives rise to the 
famous replicator ODEs as the deterministic approximation. More generally if F in 
([9]) satisfies 

F{s)-Fi-s) = s, (11) 



10 



then the corresponding mean field ODE is the rephcator dynamics. Note that [s]^ 
satisfies condition (TTT]) . In the paper we frequently use 

F«(s):=-log(expM + l) (12) 

K 



and it is easily seen that the function ( 1121) satisfies ( ITTll and converges uniformly to 
[s]^ as K — )■ oo; hence ( IT2l) can serve as a smooth regularization of ( ITOl) . and we name 
a replicator equation using (TT2|) by a regularized replicator equation. 

2.2 Mesoscopic scaling and long-range interactions 

We will consider the limit 7 — > in equation ([6]); i.e., the interaction range - 
becomes infinite and the agent at x interacts with a growing number of agents. In 
order to obtain a limiting equation, we rescale space and take a continuum limit. 
Let A C M (mesoscopic domain) and A''' := 7^^ A fl Z (microscopic domain). If A 
is a smooth region in M'^, then A'^ contains 7~'^|A| lattice sites and as 7 — )■ 0, 7A'^ 
approximates A. 

At the mesoscopic scale the state of the system is described by the strategy profile 
function ft{u,i) - the density of agents with strategy i at u. The bridge between 
microscopic and mesoscopic scale is given by the empirical measure ir'^la; du, di) de- 
fined as follows. For (f,j) G A x 5", let 6(^yj){du,di) denote the Dirac delta measure 
at (vj). 

Definition 1 (Empirical measure) The empirical measure tt"' : S^^ -^ V{A x S) 

is the map given by 

a ^ 7r^(cr; du, di) := — — ^ S(^^:r,a(x))idudi) (13) 

' ' zeAT 

where V{A x S) denotes the set of all probability measures on A x S. 
Our main result is to show that, under suitable conditions, 

TT'^{at;du,di) ^ ft{u,i)du in probability (14) 

and ft{u, i) satisfies an integro-differential equation. Since at is the state of the micro- 
scopic system at time t, Ti'^^at; du, di) is a random measure, while ft{u, i) is a solution 

11 



of a deterministic equation. So flMj) is in a sense a form of a time- dependent law of 
large numbers. For this result to hold we need to assume that the initial distribution 
for ctq is sufficiently regular. For our purpose it will be enough to assume that the 
distribution of ctq is given by a product measure with a slowly varying parameter. 

Definition 2 (Product measures with a slowly varying parameter) The col- 
lection of measure {/i'^} is called a family of product measures with a slowly varying 
parameter if n^ := (S^^gA-^ Px ^'^ S^'' '^'^'^ there exists a profile f{u,i) such that 

Pxi{i}) = f\ix,i) 



More general initial distributions can also be accommodated (See lKipnis and Landiml . 



19991 ). provided they can be associated to a mesoscopic strategy profile. Furthermore, 
below we will consider two types of boundary conditions: 

(a) Periodic Boundary Conditions. Let A = [0, l]'^ . We assume that A"^ = 
7~^A n Z = [0, -]'^nZ , and then extend the profile ft{u,i) and the configuration 
0"a7 periodically on R"' and Z*^. Equivalently we can identify A with the torus T"' and 
similarly A''' with the discrete torus T'^''^. 

(b) Fixed Boundary Conditions. In applications it is also useful to consider 
the case where the configurations in some regions do not change with time. Let 
A C r C M^ be a region. We think of dA := r\A as the "boundary region" where 
agents do not revise their strategies. Since we consider compactly supported J' we 
can take, for suitable r > 

T:=[JB{u,r), 

uGA 

where B denotes a ball centered at u with radius r. We define microscopic spaces, 

A7 := ^-lA n Z'^ and F^ := -f-^T n Z"^. 

2.3 Main results 

Let us consider first the case with periodic boundary conditions. Our assumptions 
on the interactions weights W^ {x — y) are 

(F) W^ {x — y) = 'j'^J' {'~f{x — y)) where JT" is nonnegative, continuous with compact 
support, and normalized, j J{x)dx = 1. 
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The mesoscopic strategy profiles are described by functions f{u,i) G A^(T'^ x S) 
wliere 

M{T^xS) := h e L^{T^ X S) ■.0<f{u,i) < 1, ^./(m,z) = 1 for all m G T'^} . 

Let {cJj^^Q be the stochastic process with generator L"' given by 

iL^'9)i^)= E J2^^'ix,a,k){g{a^''')-g{a)) (15) 

for g G L°°{S^ '^). Our assumptions on the strategy revision rate c'^(x, a, k) are that 
there exists a real-valued function 

c(m, 2, A;, vr), m G T^ i,keS, vr G P(T'^ x 5) 

such that 

(CI) c{u,i,k,n) satisfies 

lim sup |c'''(a;, cr, fc) — c(7x, 0"(x), A;, 7r'^(cr))| = , 

(C2) c{u,i,k,n) is uniformly bounded: i.e., there exists M such that 

sup \c{u,i,k,TT)\ < M , 

uf^T'' ,i,keS,TTeV(T'' xS) 

(C3) c{u,i,k, fdudi) satisfies a Lipschitz condition with respect to / : i.e., there 
exists L such that for all /i, /2 G M{T'^ x 5*) 

sup \c{u,i,k,fidudi)-c{u,i,k,f2dudi)\<L\\fi-f2\\^i(^j.d^g) ■ 

ueT<i,i,kes 

In the appendix we show that all the classes of rates given in the examples in 
Section [2m and several others satisfy conditions CI— C3. For example, if c'^(x, a, k) = 
F{u{x, a, k) —u{x, a, cr(x))), with u{x, a,i) = ^ W^{x — y)a{i, cr{y)) and the weights 
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W^{x — y) satisfy condition F, then 

c{u, I, kJ)=F f E <k, I) J * fiu, I) - ait, I) J * fiu, l)] (16) 

\ies J 

satisfies condition CI — C3 (recall that J * /(m, /) := J^^ J{u — v)f{v, l)dv is the 
convolution of J with /). A slight modification of ( 1T6|) yields corresponding expres- 
sions for each choice of c^{x, a, k) in Section |2TT] (see the appendix for the complete list 
of these rates). In Section 2.4 we will explain how to obtain the function c{u,i,k,7c) 
from the rates. 

The stochastic process a] induces a measure- valued stochastic process it] := 
n'^ [cr] , dudi) for the empirical given in equation f lT3|) . Theorem [1] shows that the 
stochastic process n] has a deterministic limit. 

Theorem 1 (Long Range Interaction and Periodic Boundary Condition) Suppose 
the revision rate satisfies CI — C3. Let f G A^(T'^ x S) and assume that the initial 
distribution {/i^} is a family of measures with a slowly varying parameter associated 
to the profile of f . Then for every T > 

lim TTt{du, di) = ft{u, i) dudi in probability 

7— J-O 

uniformly for t G [0, T] and ft satisfies the following differential equation: for u G 
T^,ieS 

d 

—ft{u,i) = ^c{u,k,z,f)ft{u,k)- ft{u,z)Y.c{u,z,k,f) (17) 

Cf^ fees k&s 

fo{u,i) = f{u,i) 

Next let us consider fixed boundary conditions as in Section [521 In this case, the 
stochastic process, {cr'J}t>o, is specified by the generator L'^ 

{Vg){<Jr.) = J2 Y.^\x,ar.,k){g{a-^!:)-g{ar.)) (18) 

xeAT fce5 

for g G L°°(S''"^). Note that the summation in terms of x in flTSl) is taken over A''', 
which represents the fact that only individuals in A'^ revise their strategies, whereas 
the rate depends on the configuration in entire V^ . For a given f E Ai, we define its 
restriction on A, /a(m, i) : /a(m, i) = f{u, i) H u E A and /a(u, z) = if m G A"-^. 

14 



Theorem 2 (Long Range Interaction and Fixed Boundary Condition) Suppose 
the revision rate satisfies CI — C3. Let f G A^(r'^ x S) and assume that the initial 
distribution {yU^}^ is a family of measures with a slowly varying parameter associated 
to the profile of f. Then for every T > 

lim n'Jidu, di) = ——fAu, i) dudi in probability 

7-j-o |r| 

uniformly for t G [0, T] and ft = fh^t + fdK,t satisfies the following differential equa- 
tion: for u ET,i E S 

d 

^/A,t(M,0 = Y.ciu,k,i,f)fA,t{u,k)-fA,t{u,i)Y.ciu^hk,f) (19) 

(y'^ keS k€S 

fo{u,i) = f{u,i) 

Note that c(u, k, i, /) = c(u, k, i, /a+ /qa) is given by the similar formula to flT6l) 
with J*f{u) = J-pJ'{u — v)f{y)dv for -u G A; so the rates depend on /^a as well as 
/a. 

2.4 Heuristic derivation of the differential equations 

In this section we justify, heuristically, the IDEs obtained in Theorems [H and O 
For simplicity we assume periodic boundary conditions but the other case is similar. 
The differential equations flT7|) and (IT9l) are examples of input-output equations. In 
particular, by summing over the strategy set, it is easy to see that Xlies /*(''^''^) ^^ 
independent of t and therefore if /o G A^, then ft & M. for all t. Also the space 
M. can be thought of as a product over the space of the standard strategy simplex 
A of game theory, i.e., M. = Yluci '^ . '^" ^^ shown in evolutionary game theory 



textbooks (jWeibulll . Il995l : ISandholml . l2010l ) one can derive heuristically the ODEs 



from corresponding stochastic processes. The main assumption used there is that the 
rates depend only on the average proportion of players with a given strategy. In this 
section we provide, for the convenience of a reader, a similar heuristic derivation from 
microscopic processes in the case of the spatial IDE flT7|) : we replace global average 
by spatially localized averages as expressed in the limit of the empirical measure (fT3|l . 
For microscopic sites x and y, let us denote hj u = jx and v = jy the corre- 
sponding spatial positions at the mesoscopic level. For the sake of exposition let us 
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suppose that c^(x, a, k) is given by 

c'i^x, a, k) = F{u{x, a, k) — u{x, a, <j{x)) . 

For any continuous function g on T^ x S, by the definition of the empirical measure 
( !T3|) we have the identity 

TT^^j-T Y] 9{ix,a{x))= / g{u,i)n^{a,du,di). 

Since |T'*''^| ^ 7"^^ and if we assume that vr''' (cr, (iw, di) — )■ /(m, i)dudi, we obtain 

lim V" 7'^5f(7x,o-(a;)) = / g{u,i)f{u,i)dudi. (20) 

^,gXd.7 ^ 1 X5 

Using f l20|) . we find 

hm V YJ hix-y))a(k,a(y))= / a(k,l)J(u-v)f(v,l)dvdl = y^a(k,l)J*f(u,l). 

Therefore if a{x) = i we then obtain 

c'^(a;, cr, /c) = F{u{x,a,k) — u{x,a,a{x)) 

= ^ [ Yl ^'^^ (7a;-71/)a(^,cT(y))- ^ 7"^^^ (7X - 7?/) a(a(x), a(y)) 

F I J2 <k, l)J*f{u, l)-Y, (^{h l)J*f{u, I) J = c{u, z, k, /), 

\lGS l&S J 



7-i^O 



and this gives equation (fT6l) . After having identified rates, we can now explain how 
to derive the IDE (ITTD. We write 



g{u,i)TT'^{a,dudi), {f^g):= g{u,i)f{u,i)dudi, 

where we view {Tc^'jg) [cr) as a function of the configuration a. The action of the 
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generator on this function is 



/.From the martinKale representation theorem for Markov processes (for example see 
Ethier and Kurd . Il986l ) there exists a martingale M/''^ such that 



W,^) = (vr2,(7)+ dsj^ c{u,t,k,7r-) {g{u,k) - g{u,t))7r-{dudt) + Mt\ 

Jo fcg5^Tdx5 

(21) 
As 7 — > 0, one proves that Mj^'^ — )■ 0. Thus if TT]{dudi) — )■ f{t,u,i)dudi as 7 — )■ 0, 
equation f l2T|) becomes 

{ft, g) = {fo, 9) + dsS^ c{u,i,k,f,){g{u,k)-g{u,i))fs{u,i)dudi 

Jo fce5^T<^xS 



and upon differentiating with respect to time, we find 

c(m, i, A;, /i) (5f(M, k) - g{u, i)) ftiu, i)dudi (22) 






dt 



kes 



T'ixS 



which is the weak formulation of the IDE (TT7I) obtained by integrating over u and i. 
The proof of Theorem [1] and Theorem El whi c h we present in the a ppen dix, is 
a variation on the proof given in ICometsI (|l987l) , iKipnis and LandimI ( 1l999h , and 
Katsoulakis. Plechac. and TsagkarogiannisI (120051 ) . Unlike these papers, in the case of 
non-innovative dynamics studied here there is no detailed balance condition, however 
the mesoscopic limit of the type flT^ can still be carried out in the Kac scaling 
(|6]). Using the martingale representation (I2T1) . we show that {Q^} , a sequence of 
probability laws of {tt/} , is relatively compact. We then show that all the limit 
points are concentrated on the weak solutions of ( TT9l) and on measures absolutely 
continuous with respect to Lebesgue measure. Finally we demonstrate that the weak 
solutions of f fT9|) are unique so that we conclude the convergence of Q'^ to the Dirac 
measure concentrated on the solution of (IT9D. 
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Macroscopic Proc. r/j > Mean ODE Pt(i) 

Corollaryi 



aggregate 



TheorernO] 



aggregate 



Microscopic Proc. at > Mesoscopic Equation ft{u,i) 

Theoren \l\'2\ 

Figure 3: The relationships between the microscopic process and the macro- 
scopic process and between the stochastic process and the deterministic 
approximation. 

2.5 Spatially uniform interactions: Mean-field Dynamics 

The goal of this section is to show that under the assumption of uniform interac- 
tions the spatially aggregated process is still a Markov chain (such process is called 
lumpable). Furthermore our IDEs reduce then to the usual ODEs of evolutionary 
game theory, as it should be. The relationships between the various processes and 
differential equations is illustrated in Figure [31 Let us take periodic boundary condi- 
tions and uniform interactions, i.e., JT = 1 on T'^. Let us further define the aggregate 
variables 

which counts the proportion of agents with strategy i in the entire domain T'''^. Note 
that this is obtained, equivalently, by integrating the empirical measure TT''{a,dudi) 
over the spatial domain T"'. We observe that rj"' depends on 7 only through the size 
of the domain n"^ i.e., n'^ = -^ and n'^ — )■ 00 as 7 — )■ 0. Furthermore since JT" = 1, the 
payoff u{x,a,k) depends on a only through the aggregated variable ri"'{i). Indeed, 
we have 

u{x,a,k) := — ^ ^(5(cr(?/), /)a(/c, /) = J^a(A;, z)r7"(z) 

Thus for the strategy revision rates, if cr{x) = j we define 

since the right hand side is independent of x and depends only on a through the 
corresponding aggregate variable r/". Therefore r/" itself is a Markov process as we 



will show in Theorem |3] below, and the state space for r/" is the discrete simplex 
To capture the transition induced by an agent's strategy switching, we write 



T]{i) 



if z 7^ k,j 



Vii) + ^ iii = k 

Thus rj^''' is the state obtained from rj if one agent switches his strategy from j to k. 

Theorem 3 Suppose the interaction is uniform, then rf" is a Markov chain with state 
space A" and generator 



kes jes 



(23) 



The factor n'^ in (1231) comes from the fact that in a time interval of size 1, on 
average n'^ strategy switches take place, and among those, n'^rf'^i) are switches from 
agents with type j. Theorem [3] shows that the stochastic process with uniform in- 



tera ctions coincides with multi-type bi r th an d death process in popu 



ics (jBlumd. 



1998: 



Benaim and Weibulll. 



Benaim and WeibuU 



2003r). In addition , following 



ation dynam- 



Kurtj (ll970|) 



(120031 ) , and iDarling and Norrid (120081 ) , or as a special case of 
our result (Corollary H] below) we can obtain mean field ODEs. Furthermore, at the 
mesoscopic level, the IDEs reduce to the usual ODEs of evolutionary game theory as 
follows (See Figure [3]). We note that when J = 1, we can define 



P(0 := / f{u,i)du = J* f{{) 



so c(m, k, i, f) is independent of u and this again allows to define 



c {k,i,p) ■.= c{u,k,ij) 



(24) 
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Thus, from the IDE fITTj) we obtain 



dt 



Y,^'\k,z,p)p,{k)- p,{^Y.'''\zXp). 



(25) 



fees kes 

For example, in the case of the comparing and imitative rate we have 



c'\k, I, p) = p{i)F J2 «(^' Op(o - E «(^' 0/^(0 



Jes 



les 



If F{s) = ^ log (exp (ks) + 1) , then F{s) — F{—s) = s and fl25l) becomes the (imita- 
tive) replicator dynamics. Other well-known mean field ODEs, such as logit dynamics 
and Smith dynamics, are similarly derived by choosing appropriate F. Finally, as a 
consequence of Theorem [1] we have the foll owing corollary which is the continuous- 
Benaim and Weibulll (120031 ) 's result. To state the result, we write 



time version of 



11^ IL ■=^^PiGs\V [V\- 

Corollary 4 (Uniform Interaction; Benaim and Weibull, 2003) Suppose that 
the interaction is uniform and that the strategy revision rate satisfies CI — C3. Sup- 
pose there exists p G A such that the initial condition tjq satisfies 



lim rjQ = p in probability 



Then for every T > 



lim r]^{i) — )■ Pt{i) in probability 



(26) 



uniformly for t G [0,T] and p^{i) satisfies the following differential equation: for 

ieS 



dt 



J2c^\k,t,p)p,{k) - p,{^)Y,c''{^,k,p) 



kes 
Po(0 = P(^) 



kes 



(27) 
(28) 



where c is given by [24\ )- Moreover, there exist C and eo such that for all e < cq. 
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there exists Uq such that for all n> n^ 

p|suphr-PtlL>e}<2|S|e-w. (29) 

Estimates such as (!29|) describe the vahdity regimes of the approximation by mean 
field models (1271) in terms both of agent number n and the time window [0, T] 

3 Equilibrium Selection and Pattern Formation 

In this section we illustrate the usefulness and the versatility of the IDE's derived 
in Section 12.31 by using a combination of linear analysis and numerical simulations. 
We will consider the following equations (see the rates in Section 12.11 and at the 
beginning of the Appendix) 

(a) Logit/Glauber dynamics: If the rate is given by ([H]) we obtain the IDE 

d,, .. exp{^i^a{i,l)J* ft{u,l)) 

which generalizes the well-known logit ODE of game theory. 

(b) Imitative replicator equation: Let us suppose that the rates are given by 
equation ([9]). Then we obtain 



kGS 



f{u, k)J * f{u, i)F ^(a(^, /) - a(fc, I)) J * ft{u, I) 



jes 



-f{u, %)J * /(m, k)F J2{a{k, I) - a(2, 1)) J * ft{u, I) 



J€S 



(30) 



Note that the equation depends explicitly on F. This is to be contrasted with the 
replicator ODE which is independent of F whenever F satisfies the relation F{t) — 
F{—t) = t. This is a purely spatial effect: indeed if we take f{u,i) independent of u 
for all i then equation fl30l) reduces to the replicator ODE. 

(c) Biological replicator equation: Note that one can also derive a "replicator 
IDE" using a "biological fitness" argument, i.e., the rate of change in the population 
of a given type is proportional to the difference between the fitness of this type and 
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the average fitness in the population: 



d 

—ft{u,i) = ft{u,i) 



J2 aih I) J * fiu, /) - J] fiu, k)aik, I) J * fiu, I) 

.l&S k,l£S 



This equation, while it still lacks a convincing derivation from a microscopic stochastic 
process is an interesting equation in itself and it shares many of the nice properties 
of the replicator ODEs. 

3.1 Spatio-temporal Linear Stability 

In this section we present the linear stability analysis of IDEs around stationary 
solutions as a first step to understand the gene r ation and propagation of temporal 



and spatial morphologies; we refer to iMurrayl (Il989l ) for numerous examples and 



applications of linear stability analysis of partial differential equation models. Let us 
consider the following general type of integro-differential equations: 

f = F(J*/,/) in Ax(0,T] 
f{0,x) = f{x) onAxjO} ' 

where A CR^ ^t A = T", f e MiA x S),J*f := (J * fu J * f2,- ■■, J * fnf, and 
F is smooth in both arguments. First, observe that if / is spatially homogeneous, 
i.e., f{u, t) = fit), then J*f = f{J *!) = /, and thus the IDE ^ reduces to the 
ODE 

| = F(/./). 

This ODE, in turn, is exactly the ODE obtained if the interactions are uniform 
J = const. This shows that the spatially homogenous solutions of ( 13T]) are exactly 
the stationary solutions of the corresponding mean-field ODE. In particular every 
spatially homogenous stationary solution /o, satisfies -F(/o, /o) = 0. We record this 
observation in Lemma [1] 

Lemma 1 (Space Independent Stationary Solutions) /q is a spatially indepen- 
dent stationary solution to (3l\) if and only if F{fo, /o) = 0. 

Next we study spatiotemporal perturbations of such constant states by linearizing 
around a spatially homogeneous stationary solution, /q: let / = fo + eD where 
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D = D{u,t) and substituting into fj3T]) . we obtain 



e^=F{fo + eJ*D,fo + eD). (32) 



For small e we expand the right hand side of equation ( 1321) around e = 0, ignore the 
terms of order e^ or smaller and obtain 

-^ = MJ *D + ND (33) 

ot 

where (M). • := |^ , {N).-:= |j^, and each derivative is evaluated at (/o,/o)- We 
can solve f l33|) explicitly using Fourier transform (see the appendix for details) and 
obtain the following 

Dispersion Relation: Eigenvalues for the solutions to ( 133|) are given by 

X{k) = eigenvalue{MJ{k) + N) for k E Z'^ (34) 

where JT" {k) = J^^j J[u)e^'^'^^''^du are the Fourier coefficients of J . 

In general, dispersion relations are a useful tool to investigate the generation 
and earl y-stage p r opaga tion of spatial phenomena for nonlinear PDF or IDE, see for 



instance iMurrayl ( 119891 ) . In our case ( 1M1) provides the growth (or decay) rates of 
approximate solutions to equation ( l32l) . As we will see later, identifying the Fourier 
coefficients k which are linearly unstable (i.e., \{k) > 0) allows us to identify the 
regions in phase space where instabilities occur and could lead, coupled with the 
nonlinear effects, to the formation of complex spatial structures. Finally, the linear 
stability analysis provides us computational benchmarks for our simulations. 

3.2 Example: Two-strategy symmetric coordination games 

We consider two-strategy symmetric coordination games with payoffs ([5]) being 
normalized in a way that a(l,2) = a(2, 1) = and a(l, 1) > 0, a(2,2) > 0. If 
p{u) = f{u, 1), using that f{u, 1) -|- f{u, 2) = 1 we can write a single equation for p{u) 
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and obtain an equation of the form fl3Tl) with 



Replicator IDE F^(r, s) 
Logit IDE Flirts) 



(1 - s)rF^ {(3 (r - 0) - s{l - r)F, {(3 {( - r)035) 
l{l3{r-0)-s (36) 



where C 



a(2,2) 



a(l,l)+a(2,2) 



/3 = a(l,l)+a(2,2),/(t) := 



l+cxp(-t) ' 



and F^{t) := - log (exp(Kt) + 1) 



(recall equation (TT2|) ). In equations (135|) and (!36|) r and s are variables representing 
J^*p and p, respectively. Note that ( is the mixed strategy Nash equilibrium and /3 
is positive. 

We refer to (135|) at k = oo as a replicator IDE, while we also consider the reg- 
ularized replicator IDE fl35|) for k < oo, and refer to f l36|) as a logit IDE. In addi- 
tion to the conditions for J' stated in Section 2.3, we assume that J' is symmetric: 
J{x) = J{-x) for X G A. 



3.2.1 Stationary solutions and their linear stability 

To find spatially homogenous stationary solutions, we need to set Fr (p, p) = 
and Fl {p,p) = 0. Then, for the replicator case p = 0, 1, and ( are three stationary 
solutions. In the case of logit dynamics, using 1{kz) = | + | tanh(/€|) and changing 
the variable, p i— )■ 2p — 1 := -u, the differential equation becomes 



dv B 

— = -« + tanh(|(:r*w+(l-2C))) 



(37) 



which is the well-known Glauber mesoscopic equation ( DeMasi. Orlandi. Presutti. and Triold . 



1994 



Katsoulakis and Souganidisl . 119971 : 



Presutti 



20091 ) with (3 being the inverse tem- 



perature. All known results for ( 137|) . such as the existence of traveling wave solutions in 
one space dimension and the geometric evolution of interfaces between homogeneous 
stationary states in higher dimensions, are directly applicable to the logit dynamics. 
Because of this connection, we have the following characterization of stationary so- 
lutions to logit dy namics; the pro of is the consequence of (1371) and the analysis of 
Glauber dynamics (jPresuttil . l2009l ) or it can easily be done directly. 



Lemma 2 Suppose that the game is a coordination game. Then, there exists Pq 
such that for (3 < (3(j there exists one spatially homogenous stationary solution, pi, 
and for (3 > [3(j there exist three spatially homogenous stationary solutions, pi, p2, 
and ps . 
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We note here the different role of /3 in each one of the IDEs fl35|) and fl36|) . Since 
(3 = ail + ^22, /3 measures the size of payoffs in coordination games, capturing the 
importance of the game to the players; as /3 — )■ 0, the payoffs become negligible. In 
replicator IDEs, a change in /3 merely corresponds to a time change in IDEs, as we 
can easily see from equations ( 135|) . As the game become less important, the replicator 
system evolves slowly; when the game is for high stakes, the individual's updating of 
strategy and, hence, the time evolution of the system is very fast. By contrast, in 
logit dynamics (3 becomes a parameter capturing the noise level. So when /3 is small 
(high noise), disorder pervades and the system converges everywhere to ^; everyone 
randomizes between two strategies regardless of the payoffs. As f3 gets higher (less 
noise), logit dynamics approach best response dynamics, and the payoffs weigh more. 
In this situation, the solution converges everywhere to a Nash equilibrium. 

Next we examine the linear stability of these stationary solutions. By differenti- 
ating Ffi, Fi, we find similarly to (1M|) the dispersion relations for the replicator IDE: 

p = \R{k) = F^{-f30J{k)-F^{f3() 

p = 1 Xn{k) = F, (/3 (C - 1)) J{k) - F, (/3 (1 - 0) 

P = C A^(fc)=(^ + /3C(1-C))i(^)-^ 
Table 1: Dispersion Relations for the Replicator IDE 

Note that by our assumptions of J', J{k) is real- valued and |j7'(/i;)| < 1 for all k. 
Using this fact, we obtain Proposition [1] 

Proposition 1 (Linear Stability for the Replicator IDE) p = 0, 1 are linearly 
stable for the replicator dynamics for coordination games. 

Figure H] shows one example of the dispersion relations for p = (. Observe that 
A (A;) > for A; = 0, ±1, ±2 and the solutions to linear equation ( 133|) is of the form, 
^2'Kik-x j^ggg appendix). So, when fc = 0, the corresponding solution is constant along 
space and the eigenvalue A(0) is the eigenvalue for the linearized equation of the mean- 
field ODE ( 127|) . Thus A(0) > merely shows that C, is unstable in mean-field ODE, 
and when /c = we do not expect to observe any non-trivial spatial morphologies. At 
k = ±1, the corresponding solution has a period 1, involving cos(x), sin(a;) or both 
and this solution may grow fast, dominating other solutions with different frequencies. 
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i i 4 I — \ — I 4 i i 

Figure 4: Dispersion Relation for the mixed strategy equilibrium in reg- 
ularized replicator dynamics. The figure shows the dispersion relation A/?(fc) at p = (. 
J{x) = exp (-6x2) I J g^p ^_j,2.2) dx,b^ 20, k = 20, /3 = 3, ( = 5. 

Note that the nonlinearity of the replicator IDE implies a bound on the solutions, so 
that they remain in the simplex, at each spatial location. An initially fast growing 
solution may be bounded due to the nonlinearity effects and, hence, may develop to 
a spatially heterogeneous solution. This is how we obtain the pattern formation in 
Figure [2] (upper panels). For k = ±2, we expect a similar spatial phenomenon, but 
now the solution involves cos(2a;) or sin(2a;). Hence, we anticipate a finer pattern and, 
indeed, observe this in the numerical simulation of Figure [2] (lower panels). 

In the case of logit dynamics, we note that l'(t) = l(t) (1 — l{t)), hence we easily 
obtain the dispersion relation for any stationary solution, Pq: 

XL{k)=f3{l-po)poJ{k)-l, keZ^ (38) 

Proposition 2 (Linear Stability for the logit IDEs) Suppose that < J{k) for 
all k. When /3 < jHq, the unique stationary solution po is linearly stable. When 
P > (i(j, two stationary solutions, pi, ps, are linearly stable where three stationary 
solutions Pi,P2, and p^ are arranged in Ps < P2 < Pi- 

We note that the Gaussian kernel satisfies the hypothesis, < j7'(/c) for all k. 
From table [11 we see that the dispersion relation for p = ( in the replicator IDEs 
approaches 

A^(fc) = /3C(1 - OJ{k) as K ^ 00 

and, as a result, Xiik) is less than Xni^k) at k = 00. Thus, we expect that the unstable 
steady solutions of the replicator IDE are 'more unstable' than the corresponding ones 
for logit djTiamics, and developed patterns in the replicator case may persist longer; 
this conjecture is numerically confirmed in Figure [8] below. 
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Figure 5: Comparison of equilibrium selections in mean-field ODEs and 
IDEs (Periodic BC). The upper left panel shows population densities of strategy 1 for the 
mean replicator ODE and IDE. The upper right panel depicts the case of logit rule. The bottom 
panels show the actual solutions of IDEs which were used for the comparison. N — 512. A = [— tt, it]. 
dt = 0.001/(0. 25iV2), an = ^, 022 = ^, ai2 = aai = 0. 6 = 2 for the Gaussian kernel. The initial 
density in the upper panel is i and the initial datum for IDEs isl{— ■|<a;<^}. 

Remark: Overall, the linearized analysis depicted in the dispersion relations in Table 
1 or in (!38|) for the deterministic mesoscopic IDE, allows us to easily create a phase 
diagram for pattern generation and strategies segregation, i.e. a systematic represen- 
tation of the parameter regimes of the microscopic models for which we expect to have 
nontrivial spatial structures. On the other hand such calculations, typically referred 
to in the engineering literature as 'systems t asks', are prohib i tive u sing conventional 



Monte Carlo simulations such as the ones in lSzabo and Fathl (120071 ). for the complex 
microscopic processes in Section 12. Ij this is due not only to the expense of spatial 
Monte Carlo simulations with many agents and strategies, but even more importantly 
to the large number of parameters involved in the microscopic models. 

3.2.2 Equilibrium selection: Mean-Field ODE versus Mesoscopic IDE 

To understand the importance of spatial interactions in our model compared to 
existing mean-field models, we investigate the problem of equilibrium selection for 
mean-field ODEs and spatial, mesoscopic IDEs. We ran numerical simulations of the 
solutions to the spatial IDEs and the corresponding mean-field ODEs whose initial 
values are chosen to be the spatial averages of the initial data to the IDEs. 

In the upper panels in Figure [5l we present the comparisons of population den- 
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sities of strategy 1 in the coordination game with payoffs, a(l, 1) = y, a(2,2) = y, 
a(l,2) = a(2,2) = . The values for IDE are computed by integrating the corre- 
sponding spatial solutions over space. The bottom panels show the evolutions of the 
spatial solutions which were used to generate the upper panels. We used both the 
replicator and logit equations; the left panels correspond to the rephcator equation, 
and the right panels describe the logit dynamics. As we see from the upper panels, 
the solutions to mean-field ODEs converge to the equilibrium where everyone in the 
population coordinates to strategy 2, since the initial density | belongs to the basin 
of the attraction of this equilibrium. However, a small island of 1-strategists in the 
spatial domain induces a transition toward an equilibrium of coordinating to strategy 
1, even though the total population density using strategy 1 is still |. In the replicator 
IDE case, the system reaches a metastable state — a state where both strategies co- 
exist for a very long time — and form a 1-dimensional pattern similar to Figure El In 
case of the logit IDE, the propagation of strategy 1 is much faster than the replicator 
IDE, and typically the system converges to the equilibrium of coordination to strategy 
1. Heuristically, this is because agents located near the island of 1-strategists, but are 
playing strategy 2, face a roughly 50% chance of interacting with 1-stategists and 50% 
chance of interacting with 2-strategists and, since strategy 1 yields a higher payoff 
than strategy 2, these agents are better off by adopting strategy 1. This mechanism 
propagates strategy 1 to the whole spatial domain in IDEs. 

In similar simulations, though not reported in the paper, we have observed that 
mean-field ODEs tend to overestimate the speed of convergence to equilibrium. The 
mean- field ODE systems converge to equilibrium exponentially fast, while in the 
IDEs the convergence is much slower, which represents the fact that patterns are 
metastable; for relate d metastable behavior for scalar reaction-diffusion equations we 
refer for instance to ICarr and Pegd (1l989l ).Thus. one needs to exercise caution in 



studying equilibrium selection and the convergence of the system using mean-field 
equations, especially when the spatial consideration of system is important. 

3.2.3 Traveling front solution as a way of equilibrium selection: Imitation 
versus Perturbed Best Responses 

Suppose that the domain is a subset of M with the fixed boundary conditions 
or the whole real line R. Then, this provides a natural setting to study traveling 
front solutions, see for instance Figure [H A solution is called a traveling front or 
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wave solution if it moves at a constant speed: i.e., a traveling front solution p{x,t) 
can be written as P(x — ct) for some constant c and some function P. The exis- 
tence of traveling front solutions for the logit dynamics is the direct consequences 



of known results for the Glauber equations. When ( 



2' 



the existence of a unique 



standing wave (i.e. c = 0) was proved and when t here are three equilibrium s tates 
the existence of traveling waves was e stablished ( 



DeMasi. T.Gobron. and Presuttil . 



1995 



DalPasso and DeMottoni 



Orlandi and Triolo 



11991 



C < h o'^s can find a solution that satisfies P (— oo) 



19971 ). Particularly, if 

and P (oo) = 1, and travels 



at a negative speed. Thus the value of P (oo) propagates to the whole real line and as 
t — )■ oo, the solution becomes 1 everywhere; coordination to a state with the higher 
payoffs becomes a dominating behavior. However, there is no existing rigorous result, 
so far, on the replicator IDE, though we have observed this solution in numerical 
simulations. 

To compare the traveling wave solutions for each mesoscopic dynamics, we first 
study the shapes of the standing waves. This is because the shapes of the standing 
waves may depend on how "diffusive" the system is and the diffusiveness of the system 
may, in turn, determine the speed of traveling waves. As in the usual analysis of AUen- 
Cahn type PDE and Glauber IDE, we believe that the sharpness of the standing wave 
varies with the diffusion eff ect of the equations and the more "diffusive" the sy s tem i s, 



the faster interfaces move (jCarr and Pego 



1989 



Katsoulakis and Souganidis 



19971) 



As Figure [6] shows, the shape of the standing wave in the replicator dynamics 
with K = oo is much sharper than that of the logit dynamics. In other numerical 
simulations, we have observed that the shape of the regularized replicator dynamics 
depend on n; as n become larger, the shape is getting sharper. Since F^{t) — > [t]^ as 
K — )■ oo, as K increases marginal gains from switching to a different strategy become 
higher in response to increases in the payoff of that strategy; in particular, at k = oo, 
this marginal gain becomes infinity. Thus in the replicator IDEs of high payoffs, there 
is a zero probability for actions against the optimal choice, hence the interface is very 
sharp. However, the players in the logit dynamics do not have zero probabilities for 
doing such an action when an agent is right on the "interface"; i.e., there is a nonzero 
probability to select something not optimal. That creates the "mushy" mixed region 



of a transition, see the schematic in Figure 1(a) (b). From this observation we infer 
that the logit dynamic is more "diffusive" than the replicator dynamic with k = oo; 
hence the interfaces in the logit IDEs would move faster than those in the replicator 
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Figure 6: Comparison of standing waves between the replicator and the 
logit dynamic (an = 022, Periodic BC). The upper left panel shows the time evolution 
of the population density of strategy 1 in the replicator dynamic. The upper right panel describes 
the case of the logit dynamic. The bottom panel shows the shapes of standing waves in both cases 
at time 4. We consider the replicator with k = cx). N ^ 256. A = [-7r,7r]. dt = 0.001/(0. 25iV2), 
ail = 5, a22 — 5, ai2 = 021 = 0. 6 = 2. The initial datum is l[_i7r iTrl 

IDEs. This is numerically exhibited in Figure [71 

We note that in the coordination game used for Figure [71 the equilibrium of coor- 



dina tion to strategy 1 is the one predict e d by t 



ries flHarsanvi and Selton 



Hofbauer 



19881 



Yound. 



19981 



le existing equilibrium selection theo 



Hofbauer. Hutson. and Vickers 



1997 



19971). Particularly [Hofbauer! ( Il997[ ) shows, under the best response dy- 



namics, the existence of a traveling wave solution which drives out the equilibrium of 
strategy 2, and at the same time propagates the equilibrium of strategy 1. Although 
we observe the existence of similar traveling wave solutions under various dynam- 
ics, the speed of traveling varies dramatically. As Figure 9 shows the transition is 
extremely slow in the replicator equation with k, = 00. So, when the society is charac- 
terized by imitative behaviors and marginal gains from switching is high, our model 
predicts that the transition to a "better equilibrium" is very slow and it takes a long 
time for equilibrium selection to occur. 

Finally we present another comparison between the imitative behavior with the 
perturbed best response rule using unequal payoff coordination games (an > 022) 
with the periodic boundary condition (Figure [HI). Observe that the time evolution 
of the replicator dynamic IDE in the left panel of Figure [HI corresponds to the 1- 
dimensional snap shot of the pattern formation in two dimensional replicator systems 
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Figure 7: Comparison of traveling waves between the replicator and the 
logit IDEs (Fixed BC). The upper panels show the time paths of the population densities 
for strategy 1 in the replicator with k—\ (left) and the one with k = oo (right). The lower left panel 
shows the case of the logit dynamic. In the bottom right panel we show the shapes of traveling waves 
at time 4. iV = 256. A = [-1, 1], dk = [-3, -1] U [1,3] with the fixed boundary condition p(x) = 
for X e [-3, -1] and p(x) = 1 for x G [1,3], dt = 0.001/(0.05A^2)^ ^^^ ^ 20/3, ai2 = aai = 0. & = 2 
for the Gaussian kernel. The initial datum is l[o,i]. 

in Figure |2l In Figure El the replicator system developed a spatial pattern; in the 
logit dynamic all population coordinate to an equilibrium of strategy 1 exponentially 
fast. Thus, in a society where agents adopt strategies by imitating their neighbors, 
the significant proportion of the population may spend a long time in an inefficient 
equilibrium, whereas agents with perturbed best response rules coordinate "better" 
to an efficient outcome. 

Throughout numerical simulations, we frequently observed the development of 
patterns in the replicator IDEs, while this is not the case for logit IDEs, except for 
the equal payoff coordination games. We have also observed the similar pattern for- 
mations in the regularized replicator IDEs for a reasonable range of k; the regularized 
replicator IDEs with k = 10 showed similar patterns to the replicator IDEs. 



3.3 PDE approximations of IDEs 

If the interaction kernel J is highly concentrated at the origin, or equivalently, 
the density / varies slowly with respect to space, we can consider JJyx) = e~'^J{x/e) 
as an interaction kernel for small e. Then by a change of variables and a Taylor 
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Figure 8: Replicator versus Logit (Periodic BC). The left panel shows population den- 
sity of strategy 1 for the replicator IDE with k = oo, and the right panel depicts the population den- 
sity in the logit dynamics. N ~ 512. A = [— tt, tt] with the periodic condition, dt ~ 0. 001/(0. 05A^^), 
ail — 20/3, a22 — 10/3, ai2 = 021 = 0. b = 10. for the Gaussian kernel. The initial datum is 
k ~'r jn rand cos(2x), where rand denotes a realization of the uniform random variable at each node. 



expansion, we find 



e2 



Je*f^f+jJ2Af 



where we ignore smaller order terms like e^ and A/ = (A/i, A/2, • ■ ■ , A/„)^, A/i = 
5:^ + ■ ■ ■ + If , and J2 = Xv \wf J{w)dw. Thus, by expanding F{f + f J2A/, /) in 
equation [31] around e ~ again, we find the PDE approximations of IDEs: 

-^ = Fif, /) + -eV2MA/ (39) 

where (M). • := -^ , and the derivatives are evaluated at (/,/). Intuitively, the 
coordinating behaviors imply that agents try to choose the same strategy as their 
neighbors, and this, in turn, means that the density of a given strategy tends to 
diffuse toward locations where the coordination of that strategy is more likely. This 
is how our original IDEs are related to the reaction diffusion equations in ( l39|) . For 
specific PDE expressions, we find 

Replicator f = /3/(l -/)(/- () 

+ [/3/(l -/) + (!- f)F, (/3 (/ - 0) + fF. (/3 (C - /))] f J2A/ 

Logit f = /(/3 (/ - 0) - / + wif - c))(i - mi - CW^J^M 

(40) 



Both PDEs in (1401) are reaction diffusion equations, whose reaction terms are 
of the same functional form as the mean field reactions (term /3/(l — /)(/ — C) i^i 
the replicator and /(/3 (/ — Q) — / in the logit). The diffusion terms are nonlinear 
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as the coefEcients o f the t e rms Af depend on the strategy density f. In PDE that 



Hofbauer. Hutson. and Vickers 



Hutson and Vickersl(1992h.lVickers. Hutson. and Buddl ( 1l993l ). 
( I1997I ). and iHofbauerl (119971 1 have studied for the existence of travehng wave solutions 
and pattern formation, the diffusion coefficients are constant, imphcitly modehng 
'fast' diffusion of strategies between players at different lattice sites in space at the mi- 
croscopic level, in contrast to the 'slow' strategy updating dynamics; such derivations 
of react ion- diffusion PDE fron i interac ti ng pa rticle systems with combined fast/slow 
mechanisms are discussed in 



Durrett 



( I1999I ) and references therein. However, in 
our long-range interaction models the diffusion terms are concentration-dependent, 
induced by the nonlinearities in the logit and replicator microscopic stochastic dy- 



namics, which in turn are heuristically discussed in Figure 1(a) In biology models, 
when the population pressure tends to enhance dispersal as the populatio n density 
increases, the density dependent reacti on diffusion models have been used ( iMurrayl . 



1989 



Morishital . 



1971 



Shigesadal . ll980h . 



Overall the PDEs in ( HOj) provide additional insights for the IDEs in fl35|) and (136|) . 
and their corresponding microscopic stochastic dynamics. For example, in the case of 
( l35l) . when p is close to either or 1 the diffusion term is weakest and when p lies in 
the intermediate range, the effect becomes strong. This means that the individuals 
playing strategy 1 diffuse fast, as p reaches |, because it is more likely for them to 
play with 2-strategists, so more likely to be uncoordinated. When it is highly likely 
to be coordinated, as in p = or 1, the individuals with the corresponding strategy 
do not diffuse at all. 
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A Appendix 

A.l Various strategy revision rates and proof of Theorem [2] 



Strategy Revision Rates 

We show that condition CI— C3 are satisfied for the following strategy revision rates: 

• c'^ {x,a,k) ^ F{u{x,a,k)) : c{u,i,k, f) = F {J2iaii,l) J * f {u,l)) 

• c' {x, a,k) — F (u (x, G,k) — u (x, ct, g (x))) : c{u, i, k, f) = F {"^ila {k, I) — a (i, I)] J * / (u, I)) 



' (x, a, k) = J2v ™(a;> y. ^r. k)F(u{x, a, k)) 



2{u, i,k,f) = J*f (u, k) F {Y.I a {k, l)J*f {u, I)) 



> c< (x, a, k) = Y.y -^{x, y, 0-, k)F{u (x, a, k)-u (x, a, a (x))) : c(u, i, fc, /) = J*f {u, k) F (J^i [a [k, I) ~ a {i, I)] J * / (it, I)) 



m r1 (t rr h) — cxp{u(x,a,k)) 



■ rfii i k f\ — c''P(-7*/(".fc)) 
• ^['^,t,H,,J) - Y,,c^p(J*f(u,l)) 

if F satisfies the global Lipschitz condition:!. e., for all x,y £ Dom{F) , there exists L > such that 
\F[x) — F{y)\ < L \x — y\ . Note that the list above is far from being exhaustive; one can easily invent various 
other rates which satisfy CI — C3. Since the verifications of the conditions are similar, we will check the 
conditions for the following rate (|4ip in the periodic domain. 



c'{x,a,k) = F{Y^ l'^'^{k,o{y))J{-i{y~x))- ^ -i'^a{a{x),a{y))J{'~i{x-y))) 

ySA-l !/eAT 

Lemma 3 The rate given by [J^ satisfies CI — C3. 
Proof. Let 

c'{u,i,k,a) : ^ F{^ j'^a{k,a{y))J{u - 'yy) - ^ j'^a{i,a{y))J{u ~ jy)) 

yGA-l y€A-l 

a{k, l)J{u - v)n{dvdl) - |r| / a{i, l)J{u - v)-K{dvdl)) 
where we associate u to 7X and u to 7j/. First we note that 

2_] 7 a{k,a {y))J'{'yx — ■yy) — \r\ / a{k,l)J'{rx — v)Tv''{a,dvdl) 



(41) 



(42) 






yj a{k,a{y))J'{'yx — 'yy) < \'y |A^| — |A| M —>■ uniformly in x, ct, fc 

j/eAT 



where M :— sup a(i,j)J(u,v). So by using the Lipschitz condition of F, we have 

|c''(x,(T, k) — c(7X, ct(x), fc, Tx"' (cr))| < |c^(7X,cr(x), k, a) — c{-yx,v,a{x), k,Tr~'{a))\ 



< L sup 

xGA^' 

fees 



L sup 

xeAf 

5A^ 



fees 



Y^ 'y'^a{k, a{y))J{^x - 7y) - |r| / a,{k, l)J{'yx - v)-K{a, dvdl) 

y^ 7''a(cr(x),cr(j/))J'(7X -7y) - |r| / a{a{x),l)J{'yx ~ v)'n:{a,dvdl) 
.^T^-, JrxS 



uniformly in x, o", fe 
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Hence CI is satisfied. Since c{u, i, k, ir) is uniformly bounded, C2 is satisfied. Again C3 follows from the 
fact that c {u, i, k, n) is uniformly bounded and F satisfies the Lipschitz condition. ■ 

Notations 



We use the following notations in the proof of Theorem [T] and Theorem [S] 

• {SJ*} is the stochastic process taking values at with generator L^ given in equation (|18|l and the sample 



space D([0,T],S 



.r-' 



• {n^} is the stochastic process for the empirical measure taking values ivt with the sample space D{[0, T],V{Ax 
S)) and we denote by Q^ the law of the process {II^} and by P the probability measure in the underlying 
probability space. 

The proof of Theorems [T] and [5] are so similar that we only prove Theorem [5] and leave the modifications 
needed to prove Theorem [1] to the readers. 

Martingale Estimates 

For g G C (F X S) we set 

h (a) := {^\g) = J-J2 ghy, o{y)) (43) 

' ' y<=:T~i 

We define M^''' , {M^'"') as follows: for g G C{T x S) 

Mr = (n7,5> - (n2,p) - ^'v (nL<?)ds, {ur<) = |* [v (nLs)' -ii,xii,g)V (nL<?>] ds (44) 

Since h is measura ble, so Mf '''' and (Mf '''') are J-f— martingale with r espect to P, where Tt is the filtration 
generated by {St} (|Ethier and Kurzlll986l : lDarling and Norrisl . l2008l ). 

Lemma 4 For g G C{T x 5") there exist C such that 

\L-' {^\g)\ < C, |l^ {ii\gf ~2{n\g}L-' (7v\g)\ < ^"C 
Proof. For h in (|43|l .we have 

/i(cr "=''=) - h{G) = — — (ff (7x, k) - 3(7x, (j{x)) 
and so we have equation (I45|) below. Now let q{(j) := {-k^ ,g) . Then 

qia""'^) - q{a) = — -^( J^ 9 {ly , ^"^ ''' (y))f - T^i J2 9{-yy,^iy))f 

= 7p7^ (ail^, k) - g{ix, a{x))f + -—2 {gi'yx, k) - gi^yx, a{x))) ^ girfy, a{y)) 

Thus we have 

i^{'r^,5) = Tj^Xl J2 (^''iX'<^ix)'k)igi7X,k)~g{'yx,a{x)) (45) 

L'' {Tv^gf ~2{7r\g}L-' (TT^g) ^ -^Yl E c-' {x,^{x),k) {g{ix,k) - gi'yx,a{x)f (46) 

Therefore from CI - C2, |r^l ^ |F| 7"'',and |A^| ^ |A| 7"'', the results follow. ■ 
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Proposition 3 Let g £ C {T x S) and r^ and S'' such that 

(1) T^ IS a stopping time on the process {TiJ : < t < T} with respect to the filtration Tt . 

(2) P is a constant, < S'' <T and 5^ — > as 7 — s> 0. 
Then for e > 0, there exists C such that 



(i) P{oj: sup jMf^l >€) < 



te[o,T] 
and there exists 7q such that for 7 < 7o 



s.^l ^ . k ^ ^Jl^ and (11) P {uj : \M%\s-, - M,«;'^| > e} < ^^^^ 



-y'^CT 



(ill) pL: £ L^(nL3)ds >6 



>e^ =0 



Proof. We first show (iii). Let C as in Lemma |4l Since P — >■ 0, tiicre exists 7q sucli tliat P < ^ for 
7 < 7o- Then by Lemma 3] 



tT+,5T 



LP (m,q)ds 



<S''C<-, for7<7o- 



For (i), let 7 be fixed first. Since {M-^'''f - (M»'T> = 0, P a.e. and {Mff - (Mf) is -Ft -martingale, by 
martingale inequality and Lemma [J] we have, 



P-jo; : sup IMf^l > e 
te[o,T] 



|<lE[(M|-^f] =lEKAff'^>]< 



YCT 



For (ii), by Lemma IH Chevyshev inequality, and Doob's optional stopping, we have 



P {^ : |M«;\,, - A4VI > 4 < 1e [(M«;-+,, - M« 



«'-^^l -- 1e [(M«i,V) - (^^.'^')] < ^T 



Next we prove an exponential estimate. We let r0{x) = e '^' — 1 — 9 \x\ and se(a;) = e ^ — 1 — 62; for x, 
e G M. We define 

^{a,e):^J2 E c''i^,^,k)re{h(a^''')-hia)), ^(a,e):=^ ^ c^(:r, a, fc)se(M'T^''=) - ft (a)) 
kes xeA-i keSxeA-i 



Then, from Proposition 8.8 in iDarhng and Norrii (|2008l '). we have for M|'^ in (fii)) 

Zf'^ — expjeMf'^ - f V(Sl,6l)ds| 
is a supermartingale for 6 £ R. Now we let Cg := 2 sup \g(u, i)\ , Cc := sup \c''{x, (J,k)\ . 



Lemma 5 (Exponential Estimate) There exist C depends on Cg,Cc,S and eo such that for all e < eo 
we have 

P < sup |Mf '^1 > e > < 2e rc^ 
Proof. We choose eo < | IS"! CgCcT and let A = -r^ |5| CgCcC, 9 — -^. Then since rg is increasing in R+, 



re (ft(a-'=) - ft(a)) < r^ ( ^i^C.j < i (^ J^C.s] " 6^"^^ for aU a G S^^ 
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where in the last hne we used e^ — 1 — a; < ^x^e^ for aU a; > 0. Also for e < eo. 



\K^\ " |A7| ylr^ - |A^|2 A - 2e 



Thus 



T 



(E7,0)dt < |S| |A^| -l-^]^cyeT^'^^C.T < i^ |S| Cl^eO^T = ]^A6^T for all ^ e ^ 



So, since ■<p{a,9) < <j){(7,6), 
P \ sup Mf ^ > e I = P i sup Zf'^' > exp[9e - / ^(E7, 6l)dt] i < P < sup ^'f '^ > exp[6'e - IrAO'^T] 

\t<T J \t<T Jo J I t<T 2 

where we choose C := 2 jS"! CgCce. Since the same inequality holds for — Mf '^, we obtain the desired result. 

■ 
Convergence 

Lemma 6 (Relative Compactness) The sequence {Q^} m V {D ([0, T]; P(A x 5))) is relatively compact. 

Proof. By Proposition 1.7 in lKipnis and LandimI IJ1999I . p. 54), we show that {Q^g ^} is relatively compact 
in V (£'([0, T]; R)) for each g £ C(A x S), where the definition of Q^.g^^ is as follows: for any Borel set A in 
D(\0 T] ' IR) 

Q''g-\A):=Q-'{7v.eDi[0,T];riAxS)):{7v.,g)eA} 

So, from Theorem 1 in lAldoua l| 19781 ) and Prohorov Theorem in iBillingslevI l|l968l . p. 125), it is enough to 

show that 

(i) for J7 > 0, there exists a such that 

Q^g"^ Ix e D([0,r];R) : sup|a;(t)j >al<77for7<l 

(ii) 

P{uj:\{a1,+s->,9)~{K.,9)\>^}^0 

for all e > 0, for (r^, 5'^) satisfying the condition (1) and (2) of Proposition[21 For (i), since g is bounded, it is 
enough to choose a = 2 sup |(?(it,i)|; i.e., Cf g~^ {x £ D ([0, r];K) : supj \x{t)\ > a} — Q''{7r. : sup^ K^rt, (/)| > 
a} = since \{n.,g)\ < a for all tt. For (ii) 



P 



{a; : | (H^,^,, , g) - (H?, , 3) | > .} < P {c. : \M^:,\s-, - M?:,^\ > ^] +P L : sup |Mf '^ | > | I 

*■ I t6[0,T] ^J 



-f'^CS'' 



for 7 < 7o chosen in Proposition [3] 



Let Q* be a limit point of {Q^} and choose a subsequence {Q^*"} converging weakly to Q*. Hereafter 
we denote the stochastic process defined on A'' by < E > and its restriction on F^ by < E'" > . With these 



notations, equation (|44|) becomes 



(nr,<7) = (nr,fl) + ^ f dsY^f c{u,i,Klf;){g{u,k)-g{u,i))n'^\dudi) + Mr (47) 
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Let TT £ P(r X 5) and we define 7rA(du, di) :— ■K{du D A, di). 
Lemma 7 (Characterization of Limit Points) For all e > 0, 

Q* < TT. : sup {■Kt,g) ~ {■no,g) - I ds V" / c{u,i,k,TTs){g{u,k) ~ g{u,i))7VA,s{dudi) 

[ tg[0,T] Jo j.g5 LiAxS 

i.e. the Umiting process is concentrated on the weak solutions of the IDE fifflj . 
Proof. First we define $ : D{[0, T] , P(A x 5")) -> R 



>e'>=0, 



sup (7rt,g> - (7ro,g> - / ds^ 
te[o,T] Jo s^gs 



c(u, i, A:, TVs){g{u, k) - g{u, i))-KA,sidudi) 



Then $ is continuous, hence $ ^((e, oo)) is open. From the weak convergence of {Q"'''} to Q* 



Q* {tt. : cE.(7r.) > e} < liminf Q^' {tv. : $(7r.) > e} 

I — S-OC 



Also, 



Q^ {n. : $(7r.) > e} = P J lj : sup IMf^] > e i < ^^^-^ (by Proposition E} for 7 < 7o 
[ te[0,T] J £■" 

The first equality follows from (|47p and the following equality: 



P7| ^^ -(7a: 
' a:eA7 



We denote explicitly by dm ® dw as a product measure of Lebesgue measure on A and the counting 
measure on S. 

Lemma 8 (Absolutely Continuity) We have 

Q'JTT. : nt{dudi) is absolutely continuous with respect to dm ® dv for all t £ [0,T]} — 1 . 
Proof. We define "I> : D{[0,T] ;P(r x 5")) -^R,tt. h^ supjg[o_j,] \{TVt,g)\ • Then $ is continuous. Also 



xeri 






Thus 



sup \{n],g}\<J2Jrr E 15(7^-01 



te[o,T] 



F^ 



We write n* be a trajectory on which all Q*'s are concentrated. Then U7 — > vr* (convergence in distribu- 
tion), so E (<&(n^)) -^ E ($(7r*)) . Also Tj^ Jlxery Idil^J)} ~^ /a l5('"iOI du for all I by the Riemann sum 
approximation. Thus, 



sup K^,*,5>l = $(^*)=limE(cJ,(n^))<limV^ E 13(7^-01= / IsKOI 
Therefore, for all t e [0,T], for all g G C(r x 5), 



dTn 8 dv 



TxS 



g{u, l)-Kt{dudl) 



< \g {u, l)\ dm dv 

JtxS 
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so for all t £ [0, T] ttj is absolutely continuous with respect to dm (g) dv. ■ 

We also see that all limit points of the sequence {Q''} are concentrated on the trajectories that equal 
to f'^dudi at time 0, since 



Q*^ 



>e^=0, 



g{u,i)TTo{dudi) - tttt / g{u,i)f°(u,i)dudi 

g(u,i)no(dudi) — —- / g{u,i)f {u,i)dudi 



< liminfQ^'' <{7r 

k — ^oo 



where the definition of sequ ence of product m easures with a slowly varying parameter implies the last 
equality by Proposition 0.4 Kipnis and LandimI ([1999;, p. 44). 

So far we have shown that Q* 's are concentrated on the trajectories that are the weak solutions of the 
integro-differential equations. Next we show the uniqueness of weak solutions defined in the following way. 
Let A{f){u,i) := Y^f-^gciu^k,!, f)fA{t,u,k) — /A(t,it,i) X]j,gg c(it,i, fc, /). For an initial profile /" £ M, 
/ € A4 is a weak solution of the Cauchy problem: 



dt 



A{ft), /o = f 



(48) 



if for every function g £ C{T x S), for all t < T, {ft,g) = /q {A{fs),g) ds. Observe that from C3 A satisfies the 
Lipschitz condition: there exists C such that for all fj €L°° ([0, T]; L°°(r x 5")), |U(/) - A{f)\\ < 

c||/-/1l 

Lemma 9 (Uniqueness of Weak Solutions) Weak solutions of the Cauchy problem (J^ which belong 
to 

L°° ([0,T];L^(r X S)) are unique. 

Proof. Let ft, ft be two weak solutions and ft :— ft — ft- Then, we have 

{ft,g) = I* (Aifs) - A{fs),g) ds for aU g e C{r x S) 

We show that t tn. ||/t|L2fp «> is differentiable. Define a moUifier r]{x) := Cexp ( ^rrj ) if l^^l < 1, := if 

1^1 ^ Ij C* > is a constant such that J^^ r){x)dx = 1. For e > 0, set ri^{x) :— e~'^rj{e^^x). For each u £ F, 
i £ S, define /i^,i(w, k) = ri^{u ~ v) l{i=fc} and 

fl{u,i) ■- j [ft{v,k) - ft{v,k)j hl^i{v,k)dvdk 

Then, 



A{fs) - A{fs),KA\ < \\A(fs) ^ A{fs)\\ \\hU\,, <c\\fs-f 



L2 



I_L2 



|'il,i||i2 < C sup \\f, - fs 
se[o,T] " 



L2 



Since fs - fs e L°° ([0, T];L'^{T x S)) and hl^^ £ C{T x S) for each u, i, f i-> //(«, i) is differentiable and its 
derivative is ft'iu, i) — (A{fs) — A(fs), hl^A . Also, it follows that ||/J|| ^2 is differentiable with respect to 
t and 



d_ 
di 



WftWl, = / 2(A{ft) - Aift),h'^,,) ft{u,i)dudi, so WftWl, = f \f 2{A{fs) - A{h),K^ ft{u,i)dudi 
■Irxs ^ ' Jo Urxs ^ ' 



ds 



Then since // ^ ft in || ||^2 and /* £ L°° {[0,T];L^{r x S)) for a given t, we have | \\f!\\l, - \\ft\\% \ 
— >■ 0. Also because (A{fs) ~ Aifs), hl^^i ) — >• A{ft){u, i) — A{ft){u, i) for a.e.u, and all i, t, by the dominant 
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convergence theorem we have 



so ||/t||r2 is differentiable and 



WftWl,^ l^2{Aifs)-A{.fs)Js}ds, 



I WftWl. = {A{ft)~A{ft),ft) < 2 ||^(/0 - ^(/0||^, \\ftL2 < C\\ft\\% 
Hence from Gronwell lemma, the uniqueness of the solutions follows. ■ 
Lemma 10 (Convergence in Probability) We have 

TQ{du,di) — 5- —— f(t,u,i) dudi in probability . 

Proof. So far we established Q^ => Q* (converge weakly) and equivalently 11^ -^ n* in Skorohod topology 

(topology on D([0, T],V{T'^ x S))). If we show that U] -> nt weakly in P (V' x S) or equivalently U] 4 nt 
in distribution for fixed time t <T, then we have 

117 — )> nl in probability. (49) 

Since 11^ —>■ vr* in Skorohod topology implies II^ — >■ tv^ weakly for continuity points of vr* (p. 112 [Billingslevl . 
Il968l ). it is enough to show that tt* : f i— j- ttj is continuous for all t £ [0, T] to obtain (|49p . Let to <T and 
{gfc} a dense family in C{V x S). Since 



ds 



/ {A{-Kl),gk) 

JtQ 

we choose 5 < min {1, e} . Then for \t — to| < 5, 



< (t-to) sup (yl(7r*),gfe) 
se[o,T] 



|/to (^(O'fffc) t^^l ^ '^suPsg[o.T] {AO,9k) ^ ^ sup^g^o^) (^(7r:),gfc) ^ ^ 



l + |j^« (yl(7rj),gfc)ds| l + '5sup^g[o,T] M(7rJ),5fe) 1 + sup^g[o,T] (-4(i"l),5fc) 

so ||7rt — 7rt„ llp(rxs) — ^ '^'^'-^ tt* : t n- tt* is continuous, all t G [0, T], thus all t £ [0, T] are continuity point 

of TV* ■ 

Proof of Theorem [2l 

From Lemma [TOI we have, for t < T 

lit'' {du,di) = ^^ur{dunA,di) 4 ^/t(du nyi,di) 

Since ft{u, i)(du n A)di = /A,t(u, i)dudi, from pif) we obtain 

{ft,9) = {fo,g) + dsy2 c{u,i,k,--—fsdudi){g{u,k)-g{u,i))fA.s(dudi) 

Jo fcgs-'AxS l-L I 

Since ir^inf = lA^inf"' + lA^^in^-"", jrinf 4 ft{u,i)dudi, \A\uf 4 fA,t{u,i)dudi, and lA^in^-"" 4 

fh':(u,i)dudi, we have /t = /a,* + /a<: for all t. 
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A. 2 Proof of Theorem [3] 

To do this first we define a reduction mapping, ((> : S — >■ A", 

For g G L°°(A";K) we let / := 5 o </> G L°°(S'^";R), where /(cr) = 3(7;). Then for j) = 0((t), we have 
/(a-'''-) - /(a) = 5(')"<">'') - »(')) since 

!/eA„ 

Proof of Theorm [3l We check the case of imitative and comparing rates. Other cases can be treated as 
a special case. By writing m"{k) :— J^j a{k, l)rj"{l), we find 

feSSa;eA„ 



EE 



E '5^(^)({i}) 



a;gA„ 



v{k)F{m"{k)-m"{j)){gW'')-g{ri)) 



^^n'^vU)vik)F{m''{k) - m"{j)){g{rj^''') - g{r])) ■- ^ ^ n'*c^'^(j7, j, fc)(g(77^'*) -5(77)) 
kesjss kesj^s 



Thus we obtain 



■^"fll*?) = E E ^''(^^'ivJ, k){g{vi''^) - gin)) 

k£S jes 



and this makes {rj^} a Markov chain and the rate is given by c^' {rj,j, k). ■ 

A. 3 Proof of Corollary |4] 

Proof. It is enough to prove the exponential estimate. From (|2H) we recall that 



nl,g) = (nl,g)+ J2 c{u,i,k,n1){g{u,k)-g{u,t))a1{dudi)ds + Mt'' 



for g £ C{T^ x S). By taking g{u,i) =^ 1 if z = /, g(u,i) = otherwise, we find 



n n 



Vt,i = Vo.i + n 



EM / ■ 1 n\ n \~^ M n j n\ n 



ds + Ml'"- 



We define /?;(a;) := Ylies "-^^l*' 'i ^)^i ~ Z]fcgs c*^(Z, fc, a:)a::;. Thus we have 

Vt,i = %,; +n'' I3i{v")ds + Ml'", p^i = Po_; + / Piipjds 
Jo Jo 

From Lemma [5l we have P < supt<-p Afj'" > <5 1- < 2e " ^"^o for each I and for S < So, where we note that 
the choices of Co and So does not depend on g since \g{u, J)| < 1 for all u, i. Thus, P {sup^^y IIA^riL ^ S} < 
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2 [5*1 e ^'-'o . Therefore for t < T, using the Lipschitz condition of /3 we obtain 

T<t Jo T<S t<T 

For eo in LemmaO we let 5 = ie~^^e for e < to and define 



no = {a; : ||r;;' - pj|„ < 5} , fii = <^ a; : sup \\Mr\l < S 

Then when tj G Jlo H f2i, we have sup^<y \\ri" — p^\\^ < 2(5e^"^ by Gronwell lemma. Choose no such that 
||?7g — PolL — ^ ^or '^•^- ''^ f*-"" ''- — '^0- Then for e < eo and n > no, 



'< supllry" 



pj>e} < P{^o) + Pm)<P{^--\Wo-Po\L>S}+P\uj:sup\\Mr\\„>5 
< 2\S\e ~T^ =2\S\e-^rcr 



where C := gCoe^^^. 



A. 4 Solutions of Linear IDE 

Applying Fourier transform to (|33p element by element, we obtain 



^^ = (A/i(fc) + N)D{k) (50) 

for each k £11^ and -D(fc) G C' '. By solving the ODE system (|50|) for each fc and using the inverse formula, 
we obtain 

fcez 
where e^^^^-^e^'+^J' is |S| x IS] matrix, g[k) is |S| x 1 vector. 

A. 5 Proof of Proposition [2] 

Proof. First we note that pi > C,, P2,Pi < C i liiiiK-»ooP2 ~ Ci 

P{1 - /(/?(p, - C)))K/?(P» - 0) < 1 for i = 1, 3, /3(1 - /(/3(p, - C)))K/?(P. - 0) > 1 for i = 2. 

Suppose that /3 > /S^-, and consider pi. Since l{l3{pi — C)) — Pii "*^6 have /3(1— pi)pi < 1. Then since j{k) < 1 
for all k, we have 

A(fc) = /?(! - pi)piJ{k) -!</?(!- pi)pi - 1< 

Thus pi is linearly stable. Similar argument shows that ps is linearly stable. ■ 
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